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Abstract 

For a set f2 an unordered relation on Q is a family R of subsets of fi. If R is such a relation 
we let G(R) be the group of all permutations on that preserves R, that is g belongs to G(R) 
if and only if x £ R implies x 3 £ R. We are interested in permutation groups which can be 
represented as G — G(R) for a suitable unordered relation R on Q,. When this is the case, we 
say that G is defined by the relation R, or that G is a relation group. We prove that a primitive 
permutation group 7^ Alt (Q.) and of degree > 11 is a relation groups. The same is true for 
many classes of finite imprimitive groups, and we give general conditions on the size of blocks of 
imprmitivity, and the groups induced on such blocks, which guarantee that the group is defined 
by a relation. 

This property is closely connected to the orbit closure of permutation groups. Since relation 
groups are orbit closed the results here imply that many classes of imprimitive permutation groups 
are orbit closed. 

Key Words: Group invariant relations, regular sets, orbit closure, automorphism groups 
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1 Introduction 

Let il is a set. Then the symmetric group Sym (il) acts naturally on the collection -P(il) of all 
subsets of £1. If R is a subset of P(fl) we may define the group 

Q{R) := { g € Sym (ft) : x 9 e R for all x e R] 

of all permutations that leave R invariant. In this paper we are interested in those permutation groups 
which arise in this way. We consider R as an unordered relation, or just a relation on Jl, and we 
say that a permutation group G on Q is a relation group if there is a relation R on il so that 
G = G(R)- The notion of relation group has appeared earlier in the literature, see for instance Betten's 
paper |4j. Our first result is Theorem 14.21 where we show that a finite primitive group G on £1 is a 
relation group unless G is Alt (J!) or one of ten exceptions of degree < 10. The remainder of the 



paper therefore deals with finite imprimitive groups. In Corollarv l6.2l it is shown that most imprimitive 
groups are relation groups, in the following sense: If H is an imprimitive group of degree n with a 
block of imprimitivity A so that the group induced by H on A does not contain Alt (A) and so 
that A is sufficiently large in comparison to n|A| _1 then all subgroups of H are relation groups. 
In Theorem 17.11 the same conclusion is obtained if some imprimitivity chain for H does not include 
factors belonging to a certain class of groups defined there. This allows us also to deal efficiently with 
solvable groups. 

This study of relation groups arose from a closely connected property of permutation groups. Two 
groups on ft are called orbit equivalent if they have the same orbits on P{fl). From this the orbit 
closure of G is defined as the largest group G* on ft that is orbit equivalent to G, and G is orbit 
closed if G = G* . Orbit equivalence has been studied for some time, and we give some references in 
the text. From the classification of finite simple groups there is a complete list of primitive pairs of 
orbit equivalent groups due to Seress [TS] based on an observation by Cameron, Neumann and Saxl [5] . 
More recently Seress and Young [TB] investigate the case when one of the groups is the wreath product 
of two primitive groups. 

It is almost immediate that a relation group is orbit closed, see Proposition The results mentioned 
above therefore show that large classes of permutation groups are orbit closed. In fact, we show that 
a primitive group is orbit closed if and only if it is a relation group. This however fails for infinitely 
many imprimitive groups, see Corollary 15. 21 

Independently of this application relation groups are interesting in their own right: They include the 
full automorphism groups of graphs, designs, geometries and undirected set systems generally. Our 
main tool for dealing with relation groups are regular sets for primitive groups, and this requires the 
classification of finite simple groups. We also require the explicit knowledge of primitive groups without 
regular sets in [15] . In the last section we mention open problems for relation groups and orbit closure. 



2 Prerequisites 

Throughout ft denotes a set of size n and P(fi) denotes the collection of all subsets of ft. For 
< k < n the k -element subsets of ft are denoted by fl^ . All sets and groups in this paper are 
finite. 

1. Action on Subsets: The symmetric group Sym(f2) acts naturally on P(fi) via g: x h4 x 9 := 
{uj 9 : uj E x} for g £ Sym(ri) and x £ P(fl). Let (G, ft) be a permutation group on fl and let 
x £ P(fi). Then x G = { x 9 : g £ G} is the G -orbit of x. We say that G is set-transitive if G 
acts transitively on ft^ for all k = 0,.., n. We use standard Atlas notation for groups, in particular 
C m , D m and F m are the cyclic, dihedral and Frobenius groups of order m, respectively. We write 
also S m = Sym (r) and A m = Alt (r) when |T| = m. 

Lemma 2.1 (Beaumont and Peterson [3], 1955) Let H C Sym (fl) be a set-transitive group of degree 
n>2. Then H D Alt (ft) or 

(i) n — 5 and H = F20, 
(ii) n — 6 and H = £2(5). 2 ~ S5 or 
(Hi) n = 9 and H £ {L 2 (8) C L 2 (8).3}. 

2. Regular Sets: Let (G, ft) be a permutation group on ft. We denote the setwise stabilizer of x in 
G by G x . Then x is a regular set for G if G x — 1. A key tool for this paper is the characterization of 
primitive groups without a regular set. This is obtained from the classification of finite simple groups. 
We state this result in full as we need the details later on. The set of primitive groups of degree 
5 < n < 32 in the theorem without regular set will be denoted by £nr- 
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Theorem 2.2 (Seress \Th[) Let H C Sym(f2) be a primitive group of degree n > 2. Suppose that 
H is not set-transitive. Then H has a regular set on £1 if and only if H is not one of the following: 

(i) n — b with H = D±o ; 

(ii) n — 6 with H = L 2 (5) ; 

(Hi) n = 7 with H = F 42} H = L 3 (2) ; 

(iv) n = 8 with H G {2 3 : 7.3 C 2 3 : L a (2)}, H £ {L 2 (7) C £ 2 (7).2} ; 

(«) n = 9 iwtfi H e {3 2 : (2.L 2 (3)) C 3 2 :2.L 2 (3).2}, G {3 2 :L> 8 C 3 2 :8.2 C 3 2 : 2.L 2 (3).2} ; 

fw) n = 10 uraift G {S 5 , L 2 {9) C L 2 (9).2 c L 2 (9).2.2} 

H G {L 2 (9) ~ PST/(2, 9) C PGU(2, 9)}, jff G {L 2 (9) C Mio} ; 

(vii) n = ll with H G {L 2 {11) C M u } ; 

(urn) n = 12 wrf/i i? = L 2 (ll).2, i? G {Mu C M 12 } ; 

(^'a;J n = 13 with H^L^(3); 

(x) n = 14 with H = L 2 (13).2 ; 

(xi) n = 15 with H = L 4 (2) ~ A 8 ; 

fra) n = 16 with H = 2 4 :(A 5 x 3).2, H 6 {2 4 :A 6 C 2 4 :5 6 C 2 4 :L 4 (2)}, 
H e {2 i :A 7 C 2 4 :i 4 (2)}; 

(xiii) n=17 with H G {L 2 (16).2 C L 2 (16).4} ; 

(xiv) n = 21 with H = L 3 (4).3.2 ; 

(ot) n = 22 with H G {Af 22 C A-f 22 .2} ; 

faryz^) n = 23 with H — M 2 ^ ; 

(xvii) n = 24 urai/i if = Af 2 4 ; 

(awii) n = 32 with H = 2 5 :L 5 (2). 

In each case the containments of the primitive exceptions are as indicated. In particular, a primitive, 
not set-transitive group of degree n £ {5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 21, 22, 23, 24, 32} 
has a regular set. 



Comments: 1. The theorem requires the classification of finite simple groups in the following way: 
If (G, f2) is a permutation group without regular sets then each of the 2' n l subsets of fl is stabilized 
by a non-identity element. Since a permutation composed of c cycles stabilizes exactly 2 C subsets, a 
bound for the minimum degree in G (the least number of elements by a non-identity element in G ) 
implies that G is 'large'. On the other hand, from the O'Nan-Scott Theorem and the classification of 
finite simple groups an upper bound for the order of a primitive group not containing the alternating 
group is obtained, and this yields an upper bound for the order of G. This argument due to Cameron, 
Neumann and Saxl J5 shows that all but finitely many primitive groups not containing the alternating 
group of the same degree have a regular set. In Section 7 we use the same idea to prove that all 
but finitely many such groups have regular sets of at least two different cardinalities. The list £nr 
of exceptions is obtained in Seress' theorem by further careful analysis of the bounds and by direct 
computations. 

2. There are direct methods to establish the existence of a regular set for many classes of permutation 
groups, and these methods do not require primitivity or the classification. If the group is given as 
the automorphism group of a geometrical or combinatorial object, say a graph, an affinc or projective 
space, or a design more generally, it is often possible to construct a regular set from the combinatorics of 
the structure. In the literature on graphs and set systems the more general notion of a distinguishing 
partition appears, introduced by Albertson and Collins pQ. These are partitions into an arbitrary 
number of classes so that only the identity automorphism stabilizes all classes, see the paper [TB] by 
C. Laflamme, Nguyen Van The and N. Sauer. Regular sets therefore correspond to distinguishing 
partitions into two classes. 

3. We mention some papers where regular sets are obtained by such direct methods. Cluck [8] 
determines all solvable primitive groups without a regular set. In [TT1 [T2J [6j [T] it is shown that regular 
sets exist for the affine, projective, unitary or orthogonal groups in their natural action, apart from a 
small number of explicitly listed exceptions. Often the size of a smallest regular set is determined as 
well. The problem of determining the primitive groups in which for given k all k -element subsets are 
regular is considered in Bates, Bundy, Hart and Rowley [2]. 
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3. Relations and Relation Groups: We consider a subset R of P(0) as an unordered relation 
on f2, or just a relation. (We we shall not consider the usual ordered relations.) If R is a relation 
then 

G(R) := { g € Sym (ft) : x 9 E R for all x <= i?} 

is the invariance group of i?, or the group defined by i?. Evidently a permutation group G on f2 is 
contained in G(R) if and only if R is a union of G -orbits on P(Q). We call G a relation group on 
f2 if there is some R on f2 for which G = Q{R). It is also possible to view i? as a hypergraph with 
vertex set 17, and (5(i?) as its full automorphism group. In this paper we prefer however the language 
of relations as it is natural and more flexible. 

Key examples of relation groups arise from combinatorial structures and geometry. For instance, if Q 
is the set of points of a projective or affine space S and if C C is the collinearity relation of S 

(i.e. the collinear triples) then Aut(<S) = Q{C) is a relation group by definition. In fact, we note that 
most classical groups arise in this fashion. With this in mind Betten [1] calls a relation group also a 
geometric group. The problem of representing a permutation group by an unordered relation on the 
same set was also considered in |TJ]. 

If R is a relation then its arity is the set ar(i?) = : x € R}. The arity of a relation is important 
for our purpose. The following obvious fact will be used without further mention. 

Lemma 2.3 If R' and R" are relations with ar(i?')Har(i?") = then Q(R'\JR") = Q{R')f\Q(R"). 

We call R trivial if R = [] keI ^ {fe} for some index set I C {0, 1, ..,n}. Evidently G is set-transitive 
if and only if the only relations R with G C Q(R) are the trivial relations. 



4. Orbit Equivalence: Let < k < n. Two permutation groups G and H on Q are k -orbit 
equivalent if they have the same orbits on fil fe l. We denote this by G ~ k H. The largest permutation 
group on f2 that is k -orbit equivalent to G is the k -closure of G, denoted G^ k \ and G is k -orbit 
closed, or just k -closed if G — G^ . Evidently G^ = G^ n ~ k } . The following theorem states the 
relationship between the closure groups: 

Theorem 2.4 (Siemons [17] ) Let G and H be permutation groups on Q and suppose that < k < £ 
satisfy k + £< \fl\. Then G « £ H implies G « fc H. In particular, G^> C G^ fe > and so a k -closed 
group is £ -closed. 

We say that G and H are orbit equivalent, denoted G w H, if G w* H for all < k < n. The 
orbit closure of G is the largest permutation group G* on Q that is orbit equivalent to G. We say 
that G is orbit closed if G = G*. From the theorem it follows that G* = G^"*^ where n* = |_§ J. 
There are other closure operations for permutations groups in the literature. These are derived from 
the group action on the cartesian product fi fc , rather than fl^ k \ and were first explored in Wielandt's 
Ohio lecture notes 18; . While there are interesting common features, we emphasize that in this paper 
we are not concerned with this notion of closure. 

The connection between orbit closure and relation groups, of key importance in this paper, is immediate. 
We have 

Proposition 2.5 Let G be a permutation group on ft and let R be a relation with G C Q(R). 
Suppose that 1 < k < is an integer so that no set x in R has cardinality k < \x\ < n — k. Then 
Qi k } c Q(R). In particular, a relation group is orbit closed. 
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Proof: By Theorem 12.41 the groups G and G^ fe } have the same orbits on t -element subsets for all 
t < k and n — k < t. Since G C Q(R) if and only if R is a union of G -orbits on -P(ft) we have 
G*W C Q(R) provided that no set x in R has cardinality k < \x\ < n — k. □ 

Comments: 1. For small k there are in some sense 'only few' partitions of ftW that arise as the 
orbits of a group on ft, and therefore 'only few' groups that are k -orbit closed. To be k -closed for 
small k is therefore a strong property of permutation groups. For instance, G is 1 -closed if and only 
if G = Sym (Oi ) x ... x Sym (ft t ) with ft = Ox U ... U ftt, and G is 2 -closed if and only if there is a 
(vertex and edge) coloured undirected graph on ft so that G is its full automorphism group. Much 
the same can be said about relation groups G(R) where the arity of R is bounded by k as in the 
proposition. So also in this case, to be the group of such a bounded relation is a strong property of 
permutation groups. 

2. There are transitive orbit closed groups that are not relation groups. The smallest is the Klein 
4 -group V on ft = {1,2,3,4}. It is transitive on sets of size ^ 2 and has 3 orbits on 2 -sets. 
It is easy to check that V is orbit closed. Each of the three orbits on 2 -sets gives a relation, and 
together with their complements these are the only non-trivial relations preserved by V. However, for 
any choice of an orbit (or its complement) there is a transposition not in V that stabilizes the orbit. 
Hence V C Q (R) for any relation preserved by V. In Section 5 we shall show that there are infinitely 
many imprimitive groups of this kind. 

3. In Section 4 (Corollary I4.3[) we shall prove that a primitive group is a relation group if and only if 
it is orbit closed. It is an open problem to formulate general conditions for an orbit closed imprimitive 
group to be a relation group, see also Corollary 15.31 

The primitive orbit closed groups have been determined from Lemma 12.11 and Theorem 12.21 

Theorem 2.6 (Seress [15] ) Let G C H be primitive and orbit equivalent permutation groups on ft. 
Assume that {G, H} ^ {Alt (ft), Sym (ft)}. Then 
(i) |ft| = 5 when {G, H} = {C 5 , D w } or {G, H} C {F 2Q , A 5 , S 5 }, 

(it) jftj = 6 when {G, H) C {i 2 (5).2 ~ S 5 , A 6) S 6 }, 

(lii) jftj =8 when {G, H} C {2 3 :7 C 2 3 :7.3 C 2 3 :i 3 (2)}, 

(iv) jft| = 9 when {G, H} = {3 2 :8 C 3 2 :8.2}, {G, H] = |3 2 :2. J L 2 (3) C 3 2 : 2.i 2 (3).2} or 

{G, H} C {i 2 (8), L 2 (8).3, A 9 , S 9 }, 
(v) |ft| = 10 when {G, H} = {i 2 (9).2 c L 2 (9).2.2}. 



3 Subgroups of Relation groups 

Under suitable conditions all subgroups of a relation group are again relation groups. This important 
and easy to prove property is the subject of this section. Recall that if R is a relation on ft then 
ar(i?) = {|x| : x G R} is the arity of R. 

Basic Lemma 3.1 Let H be a permutation group on ft and suppose that H has a regular set w. 
Suppose that one of the following holds: 

(i) There is a relation R on ft with H = Q{R) so that \w\ does not belong to ar(i?), or 
(ii) H is not set-transitive, and is a maximal subgroup of Sym (ft) with respect to this property. 

Let G be a subgroup of H. Then G is a relation group on ft and in particular, G is orbit closed. 
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In this paper we are interested in showing that certain classes of permutation groups are relation groups, 
and hence are orbit closed. This is an important consequence of being a relation group. However, it 
makes no sense to repeat this on each occasion. In addition, with Proposition ^. 5l in mind, even stronger 
closure properties hold for the group as soon as additional information about the arity of the relation 
in question in the Basic Lemma is available. 

Proof: (i) For G C H let R G = w G be the G -orbit of w and let r be the size of w. Then 
G C Q(R U R G ) and since r ar(i?) we have Q(R U R G ) = Q(R) n G(R G ) = H n Q{R G ) by 
Lemma T2.3I . Let h be an element of H O Q(R G ). Then there is some g e G with w h — w 9 . Hence 
hg^ 1 S H stabilizes w so that hg^ 1 — 1 and so h — g belongs to G. Therefore G = {?(i?U R ). 

(ii) As H is not set-transitive let x be a set with x H ^ fiW where k := \x\. Then H C and 
the latter is not set-transitive. By the maximality condition, H — Q{x H ). If x can be chosen so that 
k ^ r := \w\ the result follows from (i). It remains to consider the case when H is transitive on €-sets 
for all i ^ r but intransitive on r -sets. For any permutation group on f2, by the Livingstone- Wagner 
theorem, or by Theorem 12 .41 transitivity on f -sets implies transitivity on s-sets provided s + t < 
So in our case Q must have size 2r. As _ff is transitive on (r — 1) -sets we have \H\ = ( J^i) ' ^1 
for any set u of size r — 1. If = 1 we may replace iu by u, and the result follows again from (i). 
Hence we may assume that 2( r 2 ^ 1 ) < \H\. But we also have \H\ = \w H \ < ( 2 r r ) since H is intransitive 
on r -element subsets. This implies r = 0, a contradiction. Finally, if G is a relation groups then G 
is orbit closed by Proposition 12.51 □ 



Comments: 1. This lemma is useful in many situations, we give some examples. Let H be the 
group of all collineations of an affine or projective space of dimension d over the field F, viewed as a 
permutation group on the set fl of the points of the space. Let C C be the collinearity relation. 
Then H = Q{C), by definition. As mentioned in the comments following Theorem 12.21 a regular 
set w for H can be constructed by elementary means, and typically w has cardinality r — 2d or 
r = 2d ± 1. There are some exceptions for small d and \F\, the details are given in Theorems 3.1 
and 4.1 of |11) . From this information we conclude that any subgroup G of H can be expressed as 
G = Q[C U w G ). This relation is quite simple: only two set sizes are needed. It is evident that C 
can be replaced by other homogeneous relations C* which encapsulate collinearity. We note that it is 
even possible to find a relation C* C M so that G{C* U w G ) = G{C*) n Q{w G ), see QJ]. For this 
choice G — Q(C* U w G ) is the group of a homogeneous relation. 

This example shows that all subgroups of ATL(d, F), and all subgroups of PTL(d, F), are r -closed 
in their action on the points of the corresponding affine or projective space, apart from a few exceptions 
for small dimension d and small field F. This follows from Proposition 12.51 and by Theorem 12.41 we 
may take r = 2d+ 1. The small exceptions are covered in Theorem 14.21 

2. It is essential to control the arity of the relations that define a given group. Especially important 
is the case |ar(i?)| = 1, when R is homogenous. In a slightly different setting groups defined by 
a homogeneous relation appear as 2 -representable groups in Kisielewicz's paper [14] . In the second 
part of the Basic Lemma H is the group of a homogeneous relation, for if v H is any non-trivial 
H -orbit then H = Q(v H ). If G C H then the proof has shown that G = Q{R) for a relation R with 
\ax(R)\ = 2. 



4 Primitive Groups 

In this section we consider primitive groups. As a first application of the Basic Lemma we prove that 
they all are relation groups apart from a few exceptions. 
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Theorem 4.1 Let H be a primitive permutation group on CI not containing Alt (17). Suppose that 
\Cl\ > 9 and that H does not belong to the list £nr of Theorem \2.2\ Then every subgroup of H is a 
relation group. 

Remark: In the remaining case, when H does belong to £nr, it is straightforward to determine all 
relation groups contained in H by direct computation. However, we omit these details here. 

Proof: As |0| > 9 it follows from Lemma HOI that H is not set-transitive and as H is not in £nr 
it follows that H has a regular set. Without loss of generality we may suppose that H is maximal 
with the property of not being set-transitive. Now apply the second part of the Basic Lemma. □ 

Our next aim is to determine the primitive permutation groups on Cl that are not the group of a 
relation on Cl. We describe these exceptions. In our lists (n, H) means that H is a group of degree 
n = \Cl\. 

Set-transitive groups: If H Sym (Cl) is set-transitive group then H is not a relation group. Apart 
from H = Alt (Cl) by Lemma \2. II the only groups of this type are 

£st = {(5,F 20 ), (6, L 2 (5).2), (9,L a (8)), (9, i 2 (8).3)} . 

Note that none of these groups have a regular set. 

Other orbit equivalent primitive groups: Suppose that Hi C Hs ^ Hi are orbit equivalent, and not 
set-transitive. Then Hi is not a relation group, by Proposition ^. 51 From Theorem l2.6l we obtain the 
following options for Hi : 

£oe = {(5,C 5 ), (8,2 3 :7), (8,2 3 :7.3), (9,3 2 :8), (9, 3 2 : 2.L 2 (3)), (10, L 2 (9).2)}. 

The groups (8, 2 3 : 7.3), (9,3 2 : 2.L 2 (3)) and (10,L 2 (9).2) have no regular sets while the remaining 
three groups have regular sets. 

Let C = £st U £oe- None of these groups are relation groups, and together with the alternating- 
groups this determines all groups which are not relation groups: 

Theorem 4.2 Let H be a primitive permutation group on Cl not containing Alt(O). Then H is a 
relation group if and only if H does not belong to C 

Corollary 4.3 A primitive permutation group H on fi is orbit closed if and only if it is a relation 
group. If H is not a relation group then H = Alt (CI) or \Cl\ < 10. In all these cases the index of H 
in its orbit closure is divisible by 2. 

Remark: Note that primitivity is required. As mentioned before, the Klein 4 -group is orbit closed 
on {1,2,3,4} but not a relation group. We shall discuss other examples in the next sections. 

Proof of the Corollary: If H is a relation group then H is orbit closed by Proposition ^. 51 Conversely, 
by the comment above, if H is orbit closed then it is not in C and so by Theorem 14.21 we have that 
H is not a relation group. If H is not orbit closed then by the theorem, either H = Alt (CI) or H 
belongs to C . In the latter case it is easy to check that the index of G in its orbit closure is divisible 
by 2, for this see again Theorem 12.61 □ 

Proof of Theorem \4-2\ We have already shown that if H belongs to £ then H is not orbit closed and 
hence not a relation group. Conversely suppose that H is primitive on CI, does not contain Alt (0) 
and does not appear in C. Then H is not set-transitive. Let X be a group containing H that is 
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maximal subject to being not set-transitive. By maximality X is a relation group. If X has a regular 
set then the result follows from the second part of the Basic Lemma. 

It remains to inspect the cases when X has no regular set. As X is primitive it is one of the maximal 
groups in the list £nr of exceptions in Theorem l2.2l (We have H C X ^ H but H may or may not 
have a regular set.) Using the GAP libraries of primitive groups one can now inspect the primitive 
subgroups of X which do not belong to C. This yields a list of about 58 subgroups H. For all of these 
one constructs a relation 'by hand'. In some cases there is a relation group Y D H which does have a 
regular set, and in this case the Basic Lemma suffices to show that also H is a relation group. In the 
remaining cases we have computed sufficiently many H -orbits on P(O) so that a relation R can be 
stated explicitly for which H = Q{R). The following records the rough details of the computations. In 
all cases the primitive subgroup H of the group X £ £nr is a relation group or one of the exceptions 
in the list C of the theorem. 

• Degree n — 5 when H = C5 C X — D10 and H £ £oe- 

• Degree n = 6 when X — 1/2(5) has no primitive proper subgroups. 

• Degree n — 7. Here Xi = P42 = AGL(1,7) (maximal in 5V) or X2 = £3(2) (maximal in A7.) Both 
groups are 2 -transitive but neither are 3 - or 4 -homogeneous. Therefore we may represent Xi = Q(Ri) 
with Ri C and X2 = G(R 2 ) with R2 C f^ 4 ^. One primitive 2 -homogeneous group appears as 
Hi — Xi n X2 = 7: 3 = G{Ri U P2). Apart from this there are only two other groups, H2 — 7 C Hi 
and H3 = 7: 2 C X\. They are 2 -orbit equivalent, with three orbits of length 7 on . Any one of 
them provides a relations R C Sl {2} with H 3 = Q(R). Finally, H 2 = Hi n H 3 = G{R) n G(Ri U R 2 ) = 
G(RuRi U R2). 

• Degree n = 8. Here Hi = £2(7) C Xi — £2(7) .2 or various subgroups of X2 = 2 3 : 1/3(2). Both groups 
are 3 -transitive but not 4 -homogeneous. They may be represented as Xi = G{Ri) and X2 = G{R2) 
for some Ri C « {4} . For Hi we take a set w so that R := w Hl ± w Xl , see Theorem 12.61 Then 
Hi = G{R)- There are two primitive subgroups of X2, both listed in £oe- 

• Degree n — 9. There are the two set-transitive groups £2(8) C Xi = 1/2(8). 3 which both appear in 
£st- Apart from this we have X2 = 3 2 : 2. 1/2(3). 2 = AGL(2,3). This group has the primitive subgroups 
#i=3 2 :4, H 2 = 3 2 :Q 8 , H 3 = ASL(2, 3) = 3 2 : 2.L 2 (3), i/ 4 = 3 2 :_D 8 , H 5 = ATL(1, 9) = 3 2 : 8.3 
and i? 6 = AGL(1,9). These fall into the chains Hi C H 2 C H 3 C X 2 , further Hi C H4 C H5 and 
Hi C H6 C H5 C A2. The groups H3 and Ha appear in £oe, they are orbit equivalent to H$ and 
X2, respectively. 

It remains to consider Hi C H2 and H4 C H5. From computation H4 C -ffs are not orbit equivalent 
and so we may take a set wa with R4 := wf 4 7^ wf 5 . Similarly, H$ C X2 are not orbit equivalent 
which allows us to take a set ws with R5 := wf 5 7^ wf 2 . It is possible to take |u>4| = 3 and \ws\ = 4 
with [JJs| = 36. Then G(Rs) 5 H$ and G(Rs) 2 A2 implies that G(Rs) = H5 as X2 has no orbits of 
length 36 on For a similar reason ^(i?4 U -R5) = H4. Next, as H2 is not 2 -homogeneous there 

is R 2 C « {2} so that H 2 = S(i? 2 ). Finally Hi = H 4 n H 2 = G(i?4 U i? 5 U fl 2 ). 

• Degree n = 10. Here only the possibility X = PFL(2, 9) appears, with PGL(2, 9) orbit equivalent to 
it. Let Hi = Alt 5 and H 2 = Sym 5 acting on 2 -sets of a 5 -set, H 3 = PSL(2,9), H 4 = M(10) and 

= PE£(2,9). Only P"i has a regular set. The groups fall into the chains Hi C H 2 C H$ C X, 
further Hi C H 3 C H 4 C X and H 3 C H 5 . 

To define #4 = 5(Pi) select an orbit R 4 C f2 {5} of length 36, as X has Q {5} -orbits of length 180 
and 72. For H 5 = Q{R 5 ) select an orbit P 5 C H {5} of length 90. To define H 3 = G(R 3 ) select 
R 3 C {5} as the union of two orbits of length 90 and 36. For H2 = G{R2) select an orbit i?2 C 
of length 5. Finally Hi = G(R 2 U R 3 ). 

• Degree n = 11. Here only the chain Hi C H 2 C H 3 C X — Mn occurs, where Hi = 11, H2 = 11:5 
and H 3 = 1/2 (11). To define H 3 = C/(P 3 ) select an orbit R 3 C n {3} of length 55. The remaining two 
groups are contained in the relation groups AGL{1, 11) which has a regular set. Now apply the Basic 
Lemma. 

• Degree n = 12. We have Hi = Mu <zXi = A/12 and H 2 = L 2 (ll) C X 2 = L 2 (ll).2. For Hi = G(Ri) 
select an orbit Pi C fi {5} of length 132, and for H 2 = 0(P 2 ) select an orbit P 2 C fi {6} of length 
132. 

• Degree n = 13. All primitive subgroups of X — L 3 (3) are contained in the relation group AGL(1, 13) 
which does have a regular set. Now apply the Basic Lemma. 
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• Degree n = 14. Here P = PSL(2, 13) C X = PGL(2, 13) and P = Q(R) where J? is an P -orbit on 

• Degree n = 15. Here Pi, H 2 , H 3 C X = PGL(4, 2) where H 1 = A 7 (on the 15 cosets of L 3 (2) ) and 
H2 = Aa C H 3 = Se (on the 2 -subsets from a 6 -set), with P 2 C -Hi. For Pi = Q(Ri) select an 
orbit Ri C ^ {5} of length 42, and for #3 = 6(Rs) select an orbit P 3 C « {10} of length 6. Now 
H 2 = H 1 nH 3 = g(R 1 UR 3 ). 

• Degree n = 16. The only option is X = AGL(A,2) = 2 4 :L 4 (2), the group of the planarity relation in 
GF|. It has 19 primitive subgroups, four of these without regular set. We will now outline the proof 
for the fact that these are all groups of relations. (In brackets we state the GAP name of the group.) 
There are three maximal subgroups of X, these are Pi 7 = 2 4 :Se(— Gw), His = 2 4 :Ar(— G20) and 
P19 — ATL(2, 4)(= G12). In each case we name an orbit of the group on subsets that is not an orbit of 
X : For H 17 = Q(Rn) select an orbit R lr C ft {3} of length 240, for H 18 = Q(Ris) select an orbit 
Ria C fi {5} of length 672 and for H 19 = Q(R 19 ) select an orbit R 19 C fi {4} of length 20. 

We turn to groups that are maximal in one of the above. These are Pn = ATL(1, 16)(= Gg), P12 = 
(Si x &):2(= G10), P13 = 2 4 : 5 5 (= G 18 ), Pi 4 = 2 4 : A 6 (= G17), H 15 = ASL(2, 4) : 2(= G13), 
i?i6 = J 4GL(2,4)(= G14). The containments are //12, 1/13, #14, #15 C -H17, further #14, J/15 C i/is 
and Hn, Hi 5 , Hia, C H\g. In each case we name an orbit of the group that is not an orbit of any group 
properly containing it. 

For #11 = G(Rii U Rig) C Hig select an R~u -orbit R12 C Q {5} of length 480. For H12 = Q{Ri 2 U 
Rn) C i?i7 select an H12 -orbit i? i2 C fi {4} of length 8. For #13 = <5(-Ri 3 Ufo) C #17 select an 
H13 -orbit flis C tl {4} of length 40. We have Hu = Hi 7 nH w = Q{RnURiz) and H i5 = H w f]Hig = 
G(Ri S URig). For Hie = e(-Rie U Rig) C i?i 9 select an H 16 -orbit i?i 6 C fi {6} of length 1440. 
The remaining groups are contained in H12, H13, Hi 5 or i?i 6 . Each of these has a regular set of size 
6, 7 or 8. These set sizes are distinct from the set sizes of the relations defining H12, -H13, -H15 and 
Hiq. Hence the result follows from the Basic Lemma. 

• Degree n = 17. Here we consider Hi = PGL(2, 2 4 ) C H 2 = PGL(2, 2 4 ).2 C X = Pri(2, 2 4 ). All other 
primitive subgroups are contained in AGL(1, 17) which does have a regular set. Here Hi has a regular 
set but H2 does not. To have Hi = G(Ri) we find an Hi -orbit Ri C that is not an H2 -orbit. 

• Degree n = 21. We need to consider Hi = PSL(3, 2 2 ) C H 2 = PSL(3, 2 2 ), H A = PGL(3, 2 2 ) C X = 
PrL(3,2 2 ). To represent H 2 = £(P 2 ) we may select an H2 -orbit R2 C 57^ which is not an A - 
orbit and likewise, to represent P3 = Q(R 3 ) select an P"3 -orbit P3 C il^ 11 ^. Now H 1 = H 2 PI H3 = 
g(P 2 UP 3 ). 

• Degree n = 22. Here = M(22) C X = M(22).2 and P" is the automorphism group of the Steiner 
system on 22 points. 

• Degree n — 23. Here H = 23: 11 C X = M(23). Here A is the automorphism group of the Steiner 
system on 23 points and H is also a subgroup of AGL(1, 23). This is a relation group and has a regular 
set. So we may apply the Basic Lemma. 

• Degree n = 24. Here H = PSL(2, 23) C A = M 24 . In this case H is also a subgroup of PGL(2, 23) 
which is a relation group with a regular set. 

• Degree n = 32. Here we consider Pi = AGL(1, 2 5 ) C H 2 = AFL(1, 2 5 ) C A = ASL(5, 2). To represent 
P 2 = f2(P 2 ) select an P 2 -orbit P 2 C fi^ 15 ^. This group has a regular set of size 3 and so Pi is a 
relation group by the Basic Lemma. □ 



5 Wreath products 

Let if be a permutation group on the set A and let L be a transitive permutation group on the 
set S. We are interested in the imprimitive action oi K I L on := A x X. (This will be the only 
action considered here for wreath products.) First we show that the full wreath product (K I L, fi) 
is a relation group if the same is true for (K, A) and (L, E) when (K, A) is primitive. Imprimitive 
groups more generally will be considered in the next section. If R is a relation then the maximum set 
size in R is denoted by m(R) := max{ \x\ : x G R}. 
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Theorem 5.1 Let A and E be sets and put fi := A x £. Assume that (K,A) and (!>,£) are 
permutation groups where K acts primitively. 

(i) If (K, A) and (L, £) are relation groups then (K I L, fi) zs a relation group. 

(ii) If (K I L, fi) is a relation group then (K, A) is a relation group. 

In the first case, if i? s ^ is a relation for L then there exists a relation R n for K I L with 
m(R n ) = |A|m(i? s ). 

Corollary 5.2 Let (if, A) be a primitive permutation group and let (£,£) be a relation group. 
Then K I L is a relation group on A x £ if and only if (K, A) is not Alt (A) and not one of the 
groups in the list C of Section 4- 

Comment: It is essential here that we consider the full wreath product. As an illustration take 
(K, A) = (C 2 , {1, 2}) = (L, E) when C 2 lC 2 = D s is a relation group on {1, 2, 3, 4}. The Klein group 
V C C*2 I Ci is orbit closed, as we have seen earlier, but it is not a relation group. Note that D s has 
no regular set. This is not an isolated example: 

Corollary 5.3 There are infinitely many wreath products (K}L, fi) with both (K, A) and (L, E) 
primitive such that (K I L, fi) is orbit closed but not a relation group. 

Proof of Theorem \5.1\ For (i) let E = {l..s} and denote A, := A x {i} where we identify A = Ai. 
Suppose that there is a relation R A on A so that K = Q(R A ). Since K is transitive we may assume 
that all sets y in R A have size 2 < \y\ < d — 2. Correspondingly let R Ai C P(A,) be a copy of R A 
on Aj. Let 

R' = { \ y : y belongs to some R Ai } . (1) 

Let H = K ?Sym(£). We claim that H = Q(R'). Clearly, H<ZQ{R'). On fl we define an adjacency 
relation a ~ (3 if and only if there is some x € R' with \{a, [3} D x\ — 0. (In other words, a ~ /3 
if and only if {a,/3} C y for some y £ R Ai .) Evidently there is no edge from A, to Aj if i ^ j, 
and as G(R Ai ) is primitive A,; is a connected component of the graph, for i = 1, .., s. Therefore each 
element g in Q{R') permutes the A^ as sets, and if g stabilizes Aj then it preserves R Aj . Hence 
g G H and therefore Q(R') = H. Now 

R = R Al U...UR A ° (2) 

is the collection of all complements of sets in R 1 and so also H = Q{R). All sets in R have size 
< d-2. 

Next let i? E be a relation of E with L = Q(R , ) and suppose that the maximum set size in i? s is 
mj. Define 

i?" = { A 41 U ... U A lt : {ii...i t } G i? s } . (3) 
The sets in R" have size where 1 < I < ms and they are larger than any set in R. It follows that 

9(R U R") = Q(R) n G(R")- 

In particular, iOL C Q(RUR"). Conversely, if /i G Q(R\JR") then ft G Q(R) = H, and so ft permutes 
the sets Aj. Therefore ft. induces a permutation fts of E preserving i? s . Hence fts G L = Q(R ) 
and so ft belongs to K I L. Therefore K I L = Q(R U ii") is a relation group on ft. 

Conversely, for (ii) suppose that there is some relation R on fl so that K I L = G(R)- For each 
i = l...s consider the relation Ri := {y P\ Ai : y G R} and the subgroup of K I L given by 
Ki = {(1, . . . , 1, k, 1, . . . , 1) : k E K} with in position i. Then i^ fixes Aj and preserves i?j so 
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that Ki C Q(Ri). As L is transitive the permutation groups (if,, A,) are permutationally isomorphic 
to each other for i = 1...S. In particular, if = K\ C Q(R\) as a group on A = Ai. 

Assume that AT is not a relation group. From Corollary 14. 31 it follows that if is not orbit closed. Let 
therefore if* ^ if be its orbit closure, so that if C if* C G(R\) ^ if by Proposition 12.51 We show 
that this implies if* ! L C G(R), contradicting that K I L = Q{R). 

A subset a; of 51 is of the form £ = Ui=i s ( Xi > *) with Xj C A and for ft = (k%, .., k s ;b) £ K I L we 
have xft = {x x kx, lb) U ... U (x s k s , sb). To" show that if * I L C let ft,* = (fc*, .., &*;£>) E K* 1 L 

and let i be a set in i?. Then by the orbit equivalence of if and if* there are elements k\,..,k s 
in if so that x,fc? = x^fc^ for i = l...s. Let ft = (hi, .., fc s ; 6) G if I L for this choice of the fcj. Then 
xft* = (xifc*,16) U ... U (x s k*,sb) = (xifei,16) U ... U (x s k s ,sb) = xh belongs to R. Hence if is a 
relation group. □ 

Proof of Corollaries ] 5. £1 and 1 5. 3[ The first corollary is immediate. In Seress and Yang [TB] the orbit 
closed groups of type (KlL, O) with both (if, A) and (L, E) primitive are classified, when (if, A) 
has a regular set and L does not contain Alt(S). Among these groups one may take for instance 
(if, A) = (C3, 3) and any L with |E| > 9. As (C3, 3) is not a relation group Theorem 15. II implies 
that (if ? L, fi) is not a relation group. □ 



Next we are interested in conditions which guarantee that if I L has a regular set provided (if, A) 
and (L, E) have suitable regular sets. 

Proposition 5.4 Let A be a set of size d and let E be a set of size s. Assume that (if, A) and 
(L, E) are transitive permutation groups with regular sets of size r& ^ | an d r s > respectively. Then 
if I L has a regular set of size r^ = r^d + (s — 2r^)(d — r&) as an imprimitive group on — A x E. 

Proof: Let x C A be a regular set for (if , A) of size r& 7^ f and let {1, .., fc} C E be a regular 
set for (L, E) of size with k — rjj. Define a;' = A \ x and consider the following subset u> of 
!J = (Ax {1}) U ... U (A x {s}) defined by 

w = (x x {1}) U ... U (x x {fc}) U (x' x {fc + 1}) U ... U (x' x {s}) . (4) 

Then we have \w\ = r^d + (s — 2rs)(d — ta). 

We claim that w is a regular sets for if I L. Let ft G if i L with w' 1 = to. Since ft preserves the 
blocks and since |x| ^ |x'| it follows that ft permutes the block sets {(x x {1}) U ... U (x x {fc})} and 
{(x' x {fc + 1}) U ... U (x' x {s})} separately. Since {l..fc} and {k + l,..,s} are regular sets for L we 
have that (x x {i})h = (x x {i}) for 1 < i < k and (x' x {j})h = (x' x {j}) for fc + 1 < j < s. But as 
(x X {i}) and (x' X {j}) are regular sets for the H action on (A x {i}) and (A x {j}), respectively, 
we have that ft is the identity on A x {l..s}. □ 

By a similar argument we can show that if I L has a regular set provided if has sufficiently many 
sets in comparison to the degree of L. 

Proposition 5.5 Let (if, A) and (L, E) be permutation groups where L is transitive. Assume that 
if has at least |E| regular sets on A of pairwise distinct size. Then if ! L has a regular set as an 
imprimitive group on Q, = A x E. 

Proof: Let s :— |E| and let xi, .., x s G A be regular sets for if of pairwise distinct sizes. Then 

w= (xi x {!}) U ... U (x s x {s}) (5) 
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is a regular set for K I L by the same reasoning as in the proof of Proposition 15.41 



□ 



Comment: Trivially, if a group of degree n admits regular sets then it has regular sets of size < ^, 
just replace a set by its complement. In particular, in Proposition 15.41 one may select regular sets to 
have size r& < | and rn < ^ provided r% / §. 



6 Imprimitive Groups 

Let H be an imprimitive permutation group on Q and let f2i,..,Q s with f2 = Cl± U ... U Q s be a 
system of blocks of imprimitivity. (As usual, an imprimitive group is transitive.) Then H induces 
permutation groups K := on A := Oi and L := i7 s on {Qi,..,f2 s } where S := {l,..,s}. In 
particular, H C K I L acts in the imprimitive action on fi = A X E. Evidently K is primitive on A 
if and only if A is a minimal (non-trivial) block of imprimitivity of H. If R is a relation recall that 
ar(i?) = {|x| : x £ R} isthearityof R and the maximum set size in R is m{R) :— max{ \x\ : x G R}. 

Theorem 6.1 Let H be an imprimitive permutation group on fi and let A C be a minimal block 
of imprimitivity. Suppose that is a relation group on A which has at least j^j- regular sets of 

pairwise distinct size. Then every subgroup of H is a relation group. 

Proof: We put K := H%, d := |A| and n := Let R A be a relation on A with K = G{R A ). 
Let E be a set of size s :— ^, hence f! = A x S, and let R Ai be a copy of R A on A x {i}. Then 
H C H := K I Sym(E) and H = Q(R') where R is the relation defined in ([1]) in the proof of 
Theorem l5.11 All sets in R' have size > (s — l)d + 2 > ^ since s > 2. It follows from Proposition [53] 
that H has a regular set of size < ^. Now apply the first part of the Basic Lemma. □ 

Asymptotically most sets in a primitive permutation not containing the alternating group of the same 
degree are regular. More precisely we have the following: 

Corollary 6.2 There is a function d(s) so that the following is true. Let H be an imprimitive 
permutation group of degree n with a block A of imprimitivity so that 

(i) H A does not contain Alt (A), 

(ii) |A| > d(s) for s = ^. 

Then every subgroup of H is a relation group. 

Proof: We sketch the argument. Let s be fixed. Then there is a bound d(s) so that any primitive 
group (K, A) not containing Alt (A) with |A| > d(s) has at least s regular sets on A of pairwise 
different size. This is shown in Theorem 1 7. 5 1 in Section 7 for s — 2 and this argument extends readily 
to arbitrary s. Now apply Theorem 16. II □ 



Theorem 6.3 Let H be an imprimitive permutation group on £1 with a minimal block A C £1 of 
imprimitivity. Put K := H^, d := |A| and n := \Sl\. Let (L, E) with s := |E| = be the group 
induced by H on the blocks of imprimitivity. Suppose that 

(i) K is a primitive relation group and has a regular set of size r& ^ f on A, and 
(ii) L is a relation group and L has a regular set on E. 
Then every subgroup of H is a relation group on Q. 
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Proof: We follow the proof of Theorem 15.11 using the same terms. Let R and R" be as in ^ and 
, and let w be the regular set for K I L as in ®. Let GCKlL. We put R G = w G , the orbit of 
to under G, and consider 

G' := Q{R U R" U f? G ) . (6) 

Clearly G C G" and it remains to show the converse. First note that a set in R has size < d — 2 
while sets in i?" have size id with 1 < £ < . The set w has size > d . Therefore R is preserved 
by G' as a set and so 

G' = n G(R" UR G )CKl Sym (£) , (7) 

by the proof above of Theorem 1 5. II Let h be an element of G 1 . If h leaves R G invariant then also 
R" is invariant under h so that h G Q{R U i?") = K I L. This means that there is some jgG with 
to" = io 9 so that ft.<7 _1 G K I L stabilizes w. Since to is a regular set for K I L we have h = g G G. 

Hence we have to consider the situation where h does not leave i? G invariant. We claim that this is 
impossible. Let u G R G with u h G -R". Since G C K I L it follows that u decomposes over the Aj 
in the same way (U]) as w so that 

ii = Uj U ... U Mt U u 'k+i U ••• U U s 

where 2 < |tii| = ... = |ti/-| = r A < d — 2 and d — r& = \v,k+i\ = ■■■ = \u s \. Since h £ K } Sym (£) 
preserves the block structure also u h decomposes in this way. But as u h G R" this is in contradiction 
to ©. □ 



7 Some Classes of Imprimitive Relation Groups 

Let H be an imprimitive permutation group on Q and let A^ ) be some minimal (non-trivial) block 
of imprimitivity of H. Let be the group induced by H on A^ ^ and let L be the group induced 

by H on the H -images of A' '. Then H C I L. 

By repeating the same process for L we obtain a chain (K^ , A' '), .., (K®, A^) of primitive groups 
so that i? is contained in the iterated wreath product, 

H C ) (#« ; (... ) (J^*- 1 ) i K^)...)) . 

We call (K (°\ A^ ^), .., (K^\ A^) with J>1 a imprimitivity chain of length t for iJ. As there is no 
Jordan-Holder Theorem for primitivity a group may have several incomparable imprimitivity chains, 
including chains of different lengths. 

We say that H is A-imprimitive if there is a collection A of primitive permutation groups and 
some imprimitivity chain (K^°\ A^), .., (K®, A^) for i? so that (ifW,AW) belongs to ,4 for all 
i = 0...t. Similarly, if is A' -imprimitive if there is an imprimitivity chain A' '), .., (if W, A^) 

for iJ so that (if^^A^) does not belong to A for all i = 0...t. (In both cases the containment 
is up to permutation isomorphisms.) Note that a group may happen to be ^.-imprimitive and A'- 
imprimitive at the same time. 

In view of Theorem 16.31 we are interested in those primitive groups which have regular sets, all of the 
same cardinality, 

£sr := { (K, A) is primitive with regular sets, all of size ^|A| }. 

Now let 

A := { Sym (A) : | A| > 2 } U { Alt (A) : | A| > 3 } 
U £nr U Csr 

U {(5,G 5 ), (8,2 3 :7), (9,3 2 :8)}. (8) 



13 



It is easy to check that the list £st and £oe from Section 4 are contained in A. Now we have the 
following 

Theorem 7.1 Let H be an A' -imprimitive group on Q. Then all subgroups of H are relation groups 
on Q. 

Proof: Let H Q K^l(K^h(...l(K^- 1 hK^)...)) be an imprimitivity chain for H where (K®> A<1> ) 
is not in A, for all i = 0...t. As the list C from Section 4 is contained in A it follows from Theorem l4.2l 
that A W) is a relation groups for all i = 0...t. In addition, all (K W, A' 1 ') have regular sets of 

cardinality =1 ||AW|. It follows by induction from Proposition l5Tl that (-ftT (1) ! (... I (Jf( t_1 ) ? if (t) )...)) 
is a relation group with a regular set, see the comment following Proposition l5.5l Now use Theorem l6.3l 
□ 

Before we turn to the groups in Csb. specifically we are able to state several corollaries which do not 
require the explicit knowledge of this class of groups. 

Odd Degree and Odd Order: A primitive group of odd degree with at least one regular set 
automatically has two regular sets of different sizes. Therefore 

Corollary 7.2 Let H be an O 1 -imprimitive group of odd degree where O — {Sym(A), Alt (A) : 
|A| > 3} U £nr U {(5,C5), (9,3 2 :8)}. Then all subgroups of H are relation groups. 

In particular, 

Corollary 7.3 Let H be an O' -imprimitive group of odd order where O — {(3, C3), (5,6*5)}. Then 
all subgroups of H are relation groups. 

Solvable Groups: The regular sets of primitive solvable groups have been studied in Gluck [5]. 
From his result it follows that the solvable groups belonging to A form the list 

S := { Sym(A), Alt (A) : |A|<4} 

U {(5,Di ), (7,F 42 ), (8,2 3 :7.3), (9, 3 2 : (2.L 2 (3)), (9, 3 2 : 2.L 2 (3).2), (9,3 2 :£ 8 ), (9,3 2 :8.2)} 
U {(5,C 5 ), (8,2 3 :7), (9,3 2 :8)}. (9) 

Therefore the theorem provides the following 

Corollary 7.4 Let H be a solvable S' -imprimitive group. Then all subgroups of H are relation 
groups. 

Using much the same idea as in [5] we show that Csk is finite, and this will conclude the discussion 
of this particular class of groups. In a forthcoming paper we will determine Csr explicitly. 

Theorem 7.5 Let G be a primitive permutation group on Q and assume that G does not contain 
Alt (f2). Then with only finitely many exceptions G has regular sets of cardinality k± =/= k% . 

Proof: This follows from Theorem 12.21 if n — \Vt\ is odd. So let n = 2k and denote the minimal 
degree of G by m, so that m is the least number of elements in 51 moved by a non-identity element 
of G. Hence a non- identity element fixes at most 2™~tt subsets of il. Therefore the cardinality of 
tlic set 

A = {(A,g) : \A\?k, A 9 = A, g + 1} 
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can be bounded by 

'n 



< \A\ < 2 n -^ (|G| - 1). 
As the number of odd-sized (or even-sized) subsets of an n -element set is 2" _1 we have 



2 „-l < 2 " _ r*j < 2"-* |G|. 

In particular, 2"¥~ 1 < G|, and from the well-known bound 2™ < |G|, see for instance the Propo- 
sition in [5], we have 

-<log|G|-(log|G| + l). 

In particular 

n l+(log 2 n) < | G | 

for all sufficiently large 77. Using Maroti's estimate in jTU] for the order of a primitive groups it follows 
that G is a subgroup of Sym s ! Sym t acting in the product action of degree (*) * where Sym s acts 
naturally on the a -element subsets of {l...s}, for some a and t > 2. In Lemma 3.1 of [16] it is shown 
that in this action Sym s I Sym t has regular sets of at least four distinct sizes. □ 



8 Closing Remarks and Open Problems 

We conclude with a few remarks and suggestions for further work on the two topics of this paper. 

Relation Groups: From the results in Sections 5-7 one should take the view that a transitive group 
in general tends to be a relation group, and that it may not be so easy to classify the imprimitive 
groups that are not relation groups. The only firm result to show that certain kinds of imprimitive 
groups are not relation groups is Theorem 15. II A measure for a group (G, fl) to be a relation group is 

r(G) := min{ \Q(R) ■ G\ where R is a relation on ft with G C Q(R) }. 

Thus r{G) = 1 if and only if G is a relation group. 

• Is r(G) bounded in terms of the length of an imprimitivity chain for G? Are there absolute 
bounds for good classes of imprimitive group? 

• In all examples with r(G) > 1 we are aware of it appears that r(G) is even. Is this true for all 
imprimitive groups? 

Orbit Closure: In the literature orbit closure properties have been considered almost exclusively for 
groups with imprimitivity chains of length < 2. (Groups with length 2 are the two-step imprimitive 
groups in [15].) The results here on relation groups imply closure properties for arbitrary subgroups 
in the presence of suitable regular sets. A measure for a groups (G, ft) to be orbit closed is 

c(G) := \G* : G\ 

where G* is the orbit closure of G. By Proposition 12.51 we have G C G* C G(R) for any relation R 
with G C G(R) and therefore c(G) divides t"(G). 

• The set-transitive group G = £2(8) of degree 9 in Lemma [27X1 has c(G) = 6!. This is the largest 
value for c(G) we are aware of. Is there an absolute bound for c(G)? 

• Considering Corollary I5.3[ what are the groups G with 1 = c(G) < r(G)1 

Finally note that if G C Q(R) for a relation R then G C G* C Q{R) and hence r{G) = c(G) • r(G*). 
This suggests that questions about relation groups can be reduced to orbit closed groups. 
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